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1 . INTRODUCTION 

The Poisson process is a basic model for point processes 
(series of events) and can be characterized as a process in which 
the intervals between events are independent and exponentially 
distributed. In one of the earliest papers on point processes 
(Wold, 1948) an attempt was made to generalize the Poisson process 
by obtaining dependent but marginally exponentially distributed 
intervals between events. Similarly Cox (1955) attempted to 
obtain a sequence of random variables with conditionally exponential 
distributions. Neither of these attempts to generalize the Poisson 
process led to analytically tractable results. In principle, 
of course, it is simple to generate a sequence of marginally 
exponentially distributed random variables with Markov dependence 
if a bivariate exponential random variable is available. However, 
despite the recent discovery of many bivariate exponential random 
* 

Research of both authors was supported in part by NSF grant 
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Office of Naval Research. 
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variable generation schemes [Marshall and Olkin (1967), Hawkes (1972) 
Gaver (1972); Downton (1970)], none seem to have simple enough 
properties, conditional and otherwise, to lead to analytically 
and computationally tractable models for a non-independent 
(Markovian) and easily simulated sequence of marginally exponentially 
distributed random variables. Interest in the aforementioned 
processes also may have been damped by the development of physically 
motivated point process models such as the Poisson cluster process 
and the self-exciting process, for example see Neyman and Scott 
(1972). Unfortunately, many of these point process models are 
somewhat awkward to handle analytically or computationally. 

In this paper we show that if one starts with the usual 
linear, additive autoregressive equation (first-order stochastic 
difference equation) 

X = pX . + e , n = 0, + 1, + 2, . . . (1.1) 

where the innovation sequence {e n ) is one i.i.d. random vari- 
ables, then there is, for 0 <_ p < 1 , a distribution for the £ n ' s 
such that the X^'s have, marginally, an exponential distribution. 

The resulting exponential autoregressive process (EAR1) has several 
attractive features. First, the sequence is obtained as an additive 
random linear combination of random variables, and is easy to 
simulate, i.e. to realize on a computer. In simulating a queue, 
for instance, one can easily obtain sequences of correlated service 
times or interarrival times, with respectively an i.i.d. exponential 
sequence or Poisson process as a special case (p = 0). These 
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correlated sequences are useful for checking for the sensitivity 
of standard queueing results to departures from independence, and 
for other robustness studies. 

A second feature is that the EARl process (1.1) is analyti- 
cally tractable; one can, for instance, obtain the Laplace transform 
of the distribution of sums of the random variables. This is 
essential if the process is to be used as a model for point pro- 
cesses and one is to obtain the point spectrum. 

A third feature of the EARl process is that its structure 
leads to an extended model for a sequence of marginally exponentially 
distributed random variables with the correlation structure of a 
mixed autoregressive moving average process (ARMA p,q), the orders 
of the autoregression and the moving average being p and q 
respectively. Various properties of this exponential process, 
called the EARMA(p,q) process, are detailed in Lawrance and Lewis 
(1977), Jacobs and Lewis (1977) and Lawrance and Lewis (1978). 

In Section 2 of this paper we discuss the exponential 
solution of equation (1.1), as well as questions of stationarity 
and mixing. The distribution of sums of random variables from 
this process is discussed next? this relates in particular to the 
use of the process to model intervals between events in point 
processes. Joint distributions and conditional correlations of 
two and three random variables are derived in Section 4 . The 
estimation of the exponential parameter A, the reciprocal of 
E(X n ), and the correlation parameter p are briefly considered 
in Section 5 for a fixed or random number of observed random 
variables. It is shown that, because of a certain degeneracy 
in the' process, p can be estimated exactly in a long enough sequence. 
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Other solutions to equation (1.1) are considered in Section 6. 
In fact random variables for which solutions to (1.1) (in trans- 
formed version) exist are known as self -decomposable random 
variables or random variables of type L; see Feller (1971, p. 
588-90). Two cases of interest in modelling point processes 
are discussed. These require consideration of Gamma-distributed 
intervals, and intervals with a mixed exponential distribution; 
questions connected with the latter remain unresolved. 

Finally in Section 7 we consider the question of obtain- 
ing autoregressive and Markovian exponential sequences with 
negative correlation. It may be seen that (1.1) has no solution 
if P is negative. However, as soon as multivariate exponential 
sequences are considered — in particular, multivariate 
sequences which are antithetic realizations of each other 
— we discover a method for obtaining processes with exponential 
or other specified marginals and that exhibit negative 
correlation . 
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2. EXPONENTIAL SEQUENCES 

In what follows (E } will always be a seauence of i.i.d 

n 

exponentially distributed random variables with parameter A: 

P { E < x} = F„ (x) = 1 - e 
n — t 

n 

= 0 

Also an exponential (A) random variable will mean a random 
variable with distribution (2.1) . 

2.1. The exponential first-order autoreqressive sequence (EAR1) . 

The starting point of the work in this paper is the question 
as to whether the autoregressive equation (1.7) 

oo 

X = pX . + e = y p^e . Ipl < 1 (2.2) 

n n-1 n _> 0 K n-j 

has a solution for a given distribution of X^ (note that the 

expansion in (2.2) as an infinite moving average is valid because 

Ipl < 1). Now X is a function only of e e ... and 

is therefore independent of e . Therefore the Laplace-Stielt jes 

transform <j> (s) of the distribution of X is, at least for 

n n 

s > 0 , 

4> x (s) = E[exp(-sX n )] = E [exp (-spX n _ 1 + e n )] 
n 

= 4> x (ps) <J> (s) . 

n-1 'n 



(x > 0 , A > 0 ) 



( 2 . 1 ) 



(x < 0) 
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Thus 



(2.3) 



(s> 

, , x n 

6 (s) = 1 7 r 

*x (ps) 

n 

Assuming that the X n sequence is marginally stationary, we get 
the basic equation 



<Py ( S ) 

d> ( s) = -T — 7 c 

£ <J> X (P S ) 



Now it is clear that if we require the X n to be positive random 
variables, then if p is negative so is pX n and we need the 
error term e , which is independent of ^ n _]/ ma ^ e positive. 

Thus for positive random variables there will clearly be no solution 
to (2.3) for p < 0. However if we let 0 <_ p < 1 and, side- 
stepping the general question of existence and uniqueness of 
solutions to (2.3), require the X r ’ s to be exponential with 



then equation 
^(s) 



(2.3) forces 

X ' X + ps _ 1 + ps 
X + s X X + s 



(0 < p < 1, X > 0) 



= p + (1-p) 



_x 

X + S 



(2.4) 



The latter expression is the Laplace-Stielt jes transform of a 

random variable, in fact a non-negative random variable which 

has an atom of mass p at zero and which is exponential ( X) if 

positive. Thus we can write the difference equation generating 

the series {X } as 
n 
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n 



w .p . p 



w.p. (1-p) 



0 < p < 1 



(2.5) 




( 2 . 6 ) 



where {I } is an i.i.d. sequence in which I =1 with prob- 
n n 



ability (1-p) ,1=0 with probability p and {E n ) is an 
i.i.d. sequence of (A) exponentials. It is easily verified, 
directly from (2.2) or from the definition of e , that 



There are several points to be made about the sequence X^ . 

(i) When p = 0, then {X^} is an sequence of 

exponential ( A ) r.v.s. 

(ii) The representations (2.5) and (2.6) of the process as 

an (additive) random linear combination of X .. and E , 

n— 1 n 

which has a distribution independent of p, are sometimes 
more convenient than is (2.2) . 

(iii) Although is strictly a linear process (ARl) , it 





(2.7) 



differs from the normal or Gaussian process ((2.2) with 



e normally distributed of Gaussian) in that the mean, 
variance and higher moments of the e n ' s are functions 
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of the parameter p. Thus one cannot apply general theorems about 
linear processes to the exponential sequence because such 
theorems usually assume that the e 's have a distribution 
which is free of the parameter p. As an example, X^ is 
exponentially distributed even when p is close to one, 
despite theorems for linear processes which assert that 
in this case the X n are approximately normally distributed. 

For instance, if the e n ' s are independent of p then 
the skewness of the stationary distribution of X^ can 
be shown to approach zero as p t 1; in the special case 
of (2.4), this quantity is independent of p and equal 
to 2 — the value associated with the exponential d.f. 

(iv) There are many other sequences of random variables {X^} 

with exponentially distributed marginals and the first-order 
Markov property. In fact, given any bivariate exponential 
distribution F„ „ (x.,x 0 ), assumed for convenience to 

iii ^ / ±^2 i. ^ 

be absolutely continuous, with conditional density 

f £ | E (x 2 ;x^), then we construct a Markovian sequence with 
2 1 

joint density for, say, X n , X n-1 , . . . , X Q as 



f X n ,...,X 0 (x n"-" x 0 ) 



^ p I p ( ) f p I p ( X -| 7 X « ) 

E n |E n-l n n 1 E n-l |E n-2 11-1 n " 2 



E 1 |E 0 



(x, 



V 



V x °’ 
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